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MULTI-DIMENSIONAL  STOCHASTIC  ORDERING 
AND  ASSOCIATED  RANDOM  VARIABLES 

by 

Francois  Baccelli1  and  Armand  M.  Makowski2 

ABSTRACT 

This  paper  presents  several  relationships  between  the  notion  of  associated  random  vari¬ 
ables  and  notions  of  stochastic  ordering  which  have  appeared  in  the  literature  over  the  years. 
More  concretely,  the  discussion  centers  around  the  following  question:  Under  which  conditions 
does  the  association  of  the  IR- valued  RV’s  {Xi,  ...,Xn}  imply  a  possible  ordering  in  some 
stochastic  sense  between  the  ZR^-valued  RV  X  (Xi,...,Xn)  and  its  independent  version 
X  :=  (Xi,...,Xn)?  Some  of  the  results  in  that  direction  are  as  follows:  (i)  These  /Revalued 
RV’s  are  comparable  in  either  one  of  the  orderings  <st,  <ci  and  <cv  iff  they  are  identical  in 
law,  and  (ii)  If  the  RV’s  {Xi,...,Xn}  are  associated,  certain  comparison  properties  hold  for 
the  stochastic  orderings  <jr>,  <k  and  <l  defined  in  Stoyan  [8,  p.  27].  Strengthening  of  result 
(i)  leads  to  the  following  results  on  the  stochastic  ordering  properties  of  ZRn-valued  RV’s  X 
and  Y  with  identical  mean:  (j)  The  RV’s  X  and  Y  are  comparable  for  <at  iff  they  are  identical 
in  law,  and  (jj)  If  X  <D  Y  (resp.  X  <k  Y)  ,  then  X  and  Y  are  comparable  for  <„*  (resp. 
<c„)  iff  they  are  identical  in  law.  These  and  related  results  are  given  direct  applications  to 
queueing  theory  and  to  the  assymptotics  of  associated  random  variables. 
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1.  INTRODUCTION 


As  amply  demonstrated  in  the  literature  on  system  reliability,  the  notion  of  associated 
random  variables  is  a  useful  one  for  establishing  bounds  on  the  maximum  and  minimum  of 
correlated  random  variables.  This  paper  explores  possible  relationships  of  this  concept  to 
various  notions  of  stochastic  ordering  which  have  been  given  in  the  literature  over  the  years. 
The  need  for  establishing  such  connections  suggested  itself  naturally  in  the  work  on  Fork-Join 
systems  reported  by  the  authors  in  [l],  where  several  upper  bounds  on  the  system  response  time 
statistics  were  obtained  through  a  variety  of  methodologies.  More  concretely,  the  discussion 
centers  around  the  following  question  (Q),  where 

(Q)  Under  which  conditions  does  the  association  of  the  Iff- valued  RV’s  {Xi, ...,  Xn }  imply 
a  possible  ordering  in  some  stochastic  sense  between  the  ZRn-valued  RV  X  :=  (Xj, ... ,Xn )  and 
its  independent  version  X  :=  (Xi,...,Xn)? 

In  the  process  of  answering  this  question,  several  results  were  obtained  that  indicate 
how  multi-dimensional  probability  distributions  are  determined  by  conditions  on  their  one¬ 
dimensional  marginal  distributions  in  the  event  of  stochastic  comparisons. 

A  few  words  on  the  notation  and  terminology  used  throughout  this  paper:  For  any  two 
vectors  x  and  y  in  IRn,  the  ordering  x  <  y  is  interpreted  componentwise  and  is  thus  equivalent 
to  Xi  <  yi  for  all  1  <  i  <  n.  A  mapping  /  :  IRn  ->  IR  is  then  said  to  be  monotone  non¬ 
decreasing  (resp.  non-increasing)  if  x  <  y  in  IRn  implies  /(x)  <  (resp.  >)f(y)',  this  notion 
of  monotonicity  is  equivalent  to  componentwise  monotonicity.  A  mapping  /  :  IRn  — ►  IR  is 
convex  whenever  /(Ax  +  (l  —  A )y)  <  A f(x)  +  (1  —  A)/(y)  for  all  A  in  the  interval  [0, 1]  and 
every  pair  of  vectors  x  and  y  in  IRn.  In  contrast  with  the  notion  of  monotonicity  introduced 
earlier,  this  notion  of  convexity  does  not  reduce  to  componentwise  convexity. 

All  the  random  variables  (RV)  considered  in  this  paper  are  defined  on  some  fixed  prob¬ 
ability  triple  (0,  J,P).  Equality  in  distribution  (or  in  law)  between  two  2Rn-valued  RV’s  is 
denoted  by  =st.  The  definitions  of  the  various  stochastic  orderings  used  here  are  recalled 
when  needed  and  the  reader  is  invited  to  consult  the  monographs  by  Ross  [6]  and  Stoyan  [8] 
for  additional  information. 

Following  Barlow  and  Proschan  [3],  the  ffi-valued  RV’s  {X\  ,...,Xn}  are  said  to  be  asso- 
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dated  if 

£(/(X)sPO]  >  B[/(X)]J5[9(X)]  (1.1) 

for  all  monotone  non- decreasing  mappings  /,  g  :  IRn  — >  IR  for  which  the  expectations 
E[f(X)],E[g(X)\  and  E[f  (X)g(X)}  exist.  The  following  elementary  property  of  associated 
RV’s  [4,  Thm.  5.1,  pp.  1472]  provided  the  initial  impetus  for  the  work  reported  here. 

Lemma  1.  If  the  RV’s  {Xi,...,Xn}  are  associated,  then  the  inequalities 

n 

P[Xi>ai,  1  <  *  <  n  ]  >  Y[  P[  Xi  >  at  ]  (1.2 a) 

i= 1 

and 

n 

p[  Xi  <  bu  i  <  *  < » ]  >  n  pi  xi  <  ^  i  (L2&) 

i=i 

hold  true  for  all  a=  (ai,...,an)  and  b=  (bi,...,bn)  in  IRn. 

An  alternative  and  useful  way  of  expressing  (1.2)  is  obtained  as  follows:  The  ffi- valued 
RV’s  {Xi, ...,  Xn}  are  said  to  form  independent  versions  of  the  RV’s  {Ai, ...,  Xn}  if 

(i)  The  RV’s  {X\,...,Xn}  are  mutually  independent  ,  and 

(ii)  For  every  1  <  i  <  n,  the  RV’s  Xi  and  Xi  have  the  same  probability  distribution. 
With  this  notion,  Lemma  1  takes  the  following  form 

Lemma  Ibis.  If  the  RV’s  {Xi,...,Xn}  are  associated,  then  the  inequalities 

P[Xi>ai,  1  <i  <n]>  P[Xi>  a{,  1  <  *  <  n  }  (1.3a) 

and 

P\Xi<bi,  1  <i<n]>P[Xi<bi,  1  <  *  <  n  }  (1.36) 

hold  true  for  all  a  and  b  in  IRn. 

Upon  specializing  (1.3)  with  ai  =  •••  =  an  =  a  and  b\  =  •  •  •  =  bn  =  6,  it  is  plain  that 
when  the  RV’s  {Xi,...,Xn}  are  associated,  the  inequalities 

P\  min  Xi  >  a]  >  P[  min  Xi  >  a  ]  (1.4a) 

1  <i<n  l<i<n 
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and 


(1.46) 


P [  max  Xi  <  b  ]  >  P\  max  Xi  <  b  ] 

l<t<re  l<i<n 

hold  true. 

Following  Stoyan  [8],  with  minor  variations  in  the  notation  and  terminology,  the  /Re¬ 
valued  RV  Y  is  said  to  be  stochastically  larger  than  the  ZRn-valued  RV  X  if  and  only  if  the 
inequality 

E[f(X)\  <  E[f(Y )]  (1.5) 

holds  for  all  monotone  non- decreasing  mappings  /  :  IRn  — *•  IR  for  which  the  expectations 
exist;  this  is  denoted  in  short  by  X  <,t  Y.  For  the  special  case  n  =  1,  the  inequality  X  <st  Y 
holds  if  and  only  if 

P[X  >t}<  P[Y  >  t]  (1.6) 

for  all  t  in  IR. 

With  this  notation,  it  is  now  easy  to  conclude  that  when  the  RV’s  {Xi,...,Xn}  are  asso¬ 
ciated,  the  inequalities  (1.4)  are  equivalent  to  the  order  relations 

min  Xi  <st  min  Xi  (1.7a) 

l<t<n  l<t<n 


and 


max  Xi  <st  max  Xi.  (1-76) 

l<i<n  l<t<n 


These  properties  (1.7)  above  already  explain  the  usefulness  of  the  notion  of  association  of  RV’s 
in  a  wide  variety  of  situations,  for  they  suggest  a  natural  way  of  generating  computable  bounds 
for  the  statistics  on  the  maximum  and  minimum  of  the  RV’s  {Xi,  ...,X„,}.  These  statistics 
are  typically  very  difficult  to  compute  in  the  presence  of  inter-variable  correlations  ,  as  is  the 
case  in  many  stochastic  models  of  interest  [l]  . 


2.  THE  RESULTS 

At  this  stage,  the  reader  might  wonder  in  view  of  (1.7)  whether  the  property  that  the 
RV’s  {Xi,...,Xn}  are  associated,  implies  a  possible  ordering  in  some  stochastic  sense  for  the 
/Revalued  RV’s  X  :=  (Xi,...,Xn)  and  X  :=  (X1?  ...,X„).  For  instance,  is  it  possible  under 
some  conditions  that  X  <st  X,  a  fact  which  would  be  compatible  with  (1.7b)?  The  main 


4 


results  along  these  lines  are  negative  for  all  three  orderings  <gt,  <ci  and  <cv.  This  is  the  basic 
content  of  Theorems  1  and  2  below. 

Theorem  1.  Assume  the  IR-valued  RV’s  {Xi,...,Xn}  to  be  associated,  with  corresponding 
independent  versions  {Xi,...,Xn}.  Under  the  foregoing  assumptions,  the  statements  (i)-(iii) 
below  are  equivalent,  where 

(i)  The  RV’s  X  and  X  are  comparable  for  the  stochastic  ordering  <st , 

(ii)  The  RV’s  {Xi, Xn}  are  mutually  independent,  and 

(iii)  The  RV’s  X  and  X  coincide  in  law. 

A  proof  for  Theorem  1  is  provided  in  Section  4.  This  result  is  not  as  surprising  as  it  may 
initially  appear.  Indeed,  if  the  RV’s  X  and  X  were  comparable,  say  X  <st  X,  then  elemen¬ 
tary  properties  of  the  stochastic  ordering  <3t  readily  imply  the  inequality  mini<;<n  JSQ  <st 
mini<t<nXj,  since  the  mapping  IRn  — >  IR  :  x  — >  mini<i<n  z;  is  monotone  non-decreasing. 
The  fact  that  the  RV’s  {Xi,...,Xn}  are  associated  now  implies  via  (l.7a)  that  the  equality 
mini<j<nXi  =at  mini<i<„Xi  must  hold,  thus  adding  plausibility  to  Theorem  1. 

A  first  extension  of  Theorem  1  is  given  in  Theorem  2  below  where  it  is  shown  that  the 
stochastic  ordering  <st  in  the  statement  (i)  can  be  replaced  by  a  weaker  ordering  condition. 

To  that  end,  recall  that  the  IRn-\ alued  RV  Y  is  said  to  be  larger  than  the  IRn-v alued 
X  in  the  stochastic  convex  (resp.  concave)  increasing  order  if  (1.5)  holds  for  all  monotone 
non- decreasing  convex  (resp.  concave)  mappings  /  :  IRn  — *  IR  for  which  the  expectations 
exist;  this  is  denoted  in  short  by  X  <cj  Y  (resp.  X  <cv  Y). 

Theorem  2.  Assume  the  IR-valued  RV’s  {Xi,...,Xn}  to  be  associated  and  to  have  finite 
mean.  Under  the  foregoing  assumptions,  the  statements  (i)-(iii)  below  are  equivalent,  where 

(i)  The  RV’s  X  and  X  are  comparable  for  the  stochastic  ordering  <ci  (resp.  <Cv)i 

(ii)  The  RV’s  {Xi,...,Xn}  are  mutually  independent,  and 

(iii)  The  RV’s  X  and  X  coincide  in  law. 

Note  that  whenever  the  RV’s  {Xi,...,X„}  are  associated,  so  are  the  RV’s  {X;, , ...,  Xik  }, 
with  1  <  *i  <  *2  <  ...  <  %k  <  n  f°r  every  2  <  k  <  n.  Theorems  1  and  2,  for  the  orderings  <st, 
<ci  and  <cv,  respectively,  thus  state  that  no  subvector  of  X  is  comparable  to  the  corresponding 
subvector  of  X,  unless  the  involved  components  are  already  mutually  independent. 
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Despite  these  negative  results,  it  is  noteworthy  that  the  association  of  the  RV’s 
{Xi, ..., Xn}  implies  certain  comparison  properties  for  the  stochastic  orderings  <d  and  <k 
for  ZRn-valued  RV’s  defined  in  Stoyan  [8,  p.  27].  More  precisely,  the  ZRn-valued  RV  Y  is  said 
to  be  greater  than  the  ZRn-valued  RV  X  in  the  orders  <d  and  <k,  respectively,  if  and  only  if 
the  inequalities 

P[  Xi  <  ai?  1  <  »  <  n  ]  >  P[  Yi  <  at,  1  <  *  <  n  ]  (2.1) 

and 

P[  Xi  >  bi,  1  <i<n]<P[Yi>  bi,  1  <  i  <  n  }  (2.2) 

hold  for  all  a  and  b  in  IRn,  respectively.  This  is  denoted  in  short  by  X  <d  Y  and  X  <k  Y, 
respectively,  and  as  pointed  out  in  [8,  Prop.  1.10.1,  p.27]  and  in  [5,  Thms  2  and  3,  pp. 
1314-1315],  the  former  is  equivalent  to 

-  n  -i  n 

e  >*n*t*>  (2-3) 

■t=i  ^i=i 

for  every  collection  {ffi,  ...,ffn}  of  monotone  non-increasing  mappings  IR  — ►  IR- 1_,  whereas  the 
latter  is  equivalent  to 

*[ri/<pd  >E\um)  (2-4) 

-i=l  s=i 

for  every  collection  {/i, ...,  /«.}  of  monotone  non-decreasing  mappings  IR  — ►  IR+.  It  is  easy  to 
see  from  these  characterizations  that  X  <stY  implies  both  X  <r>  Y  and  X  <k  Y. 

A  simple  rephrasing  of  the  inequalities  (1.3)  now  leads  to  the  following  comparison  results. 
Theorem  3.  Whenever  the  IR-valued  RV’s  {Xi, ..., Xn}  are  associated,  both  inequalities 

X  <d  X  and  X  <k  X  (2-5) 

hold  true. 

Owing  to  Theorem  3,  if  the  associated  RV’s  {Xi,...,Xn}  are  all  non-negative,  then  spe¬ 
cializing  (2.3)  to  the  negative  exponentials  gi  :  IR  — »  IR+  :  t  —>  e  3,t,  with  0  <  s*  for  all 
1  <  t  <  n,  readily  gives 

£[exp(—  J2  ^  #[exp(-  it, =  n  ^[exp(-SiXi)].  (2.6) 

i+l  i= 1  i=1 
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This  remark  can  be  generalized  as  follows  [8,  Defn.  1.8.1,  p.  22]. 

Corollary  3.1.  If  the  RV’s  (Xi,  ...,Xn}  and  {Yi,...,Yn}  are  all  non-negative  with  X  <d  Y, 
then  for  any  a=  (ai,...,are)  in  IR+,  the  inequality 

n  n 

£><^<E,]T>Yi  (2.7) 

i=l  i= 1 

holds  with  <£  denoting  the  stochastic  order  on  one-dimensional  distributions  induced  by  the 
Laplace  transform. 

In  particular,  if  ax  =  •  •  •  =  an  =  1,  the  inequality 

n  n 

X>,  <lX>  (2-8) 

1=1  t=l 

holds.  Therefore,  with  Y  =  X,  (2.8)  asserts  that  the  sum  of  associated  non-negative  RV’s  is 
smaller  in  the  ordering  <l  than  the  corresponding  quantity  for  their  independent  version,  a 
fact  very  much  in  the  spirit  of  (1.7). 

The  remaining  of  this  section  is  devoted  to  the  discussion  of  several  extensions  of  Theorems 
1  and  2.  Theorem  2  admits  a  first  strengthening  in  the  form  of  Theorem  2bis  whose  proof  is 
delayed  to  Section  4. 

Theorem  2bis.  Assume  the  IRn-valued  RV’s  X  and  Y  to  have  finite  identical  means,  namely 

E[Xi]  =  E[Yi\ ,  1  <  i  <  n  (2.9) 

and  to  satisfy  the  stochastic  ordering  relation 

X  <d  Y  (resp.  Y  <k  X).  (2-10) 

Under  these  conditions,  the  statements  (i)  and  (ii)  below  are  equivalent,  where 

(i)  The  RV’s  X  and  Y  are  comparable  for  the  stochastic  ordering  <ci  (resp.  <cv);  and 

(ii)  The  RV’s  X  and  Y  coincide  in  law. 

That  Theorem  2bis  contains  Theorem  2  can  be  seen  as  follows:  Assume  the  RV’s 
{ATi,  •  •  • ,  Xn}  to  be  associated  and  to  have  finite  mean.  By  Theorem  3,  the  pair  of  RV  s 
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X  and  Y  =  X  satisfy  the  assumptions  of  Theorem  2bis,  and  Theorem  2  is  obtained  from  it  as 
an  immediate  corollary.  It  should  be  emphasized  that  the  situation  covered  by  Theorem  2bis  is 
more  general  in  several  ways.  Indeed,  comparison  in  the  stochastic  ordering  <„*  (resp.  <cv )  is 
assumed  between  two  ZRn-valued  RV’s  X  and  Y  with  the  RV  Y  not  necessarily  an  independent 
version  of  the  RV  X\  the  RV’s  {Xi,  •  ■  •  ,Xn}  may  not  be  associated  and  the  condition  that  X 
and  Y  have  the  same  one-dimensional  marginal  distributions  is  replaced  by  the  condition  that 
X  and  Y  have  the  same  mean. 

The  last  results  of  this  section  are  given  in  Theorems  4  and  4bis  below,  and  consitute  a 
strengthening  of  Theorem  1. 

Theorem  4.  Assume  the  IRn -valued  RV’s  X  and  Y  to  have  finite  identical  means,  namely 

E[Xi \  =  E[Yt ],  1  <i<n  (2.11) 

Under  this  condition,  the  equality  in  law 

X  =3t  Y  (2.12) 

holds  if  and  only  if  the  RV’s  X  and  Y  are  comparable  for  the  stochastic  ordering  <at  ,i.  e., 

X<atY  or  Y<atX  (2.13) 

holds. 

Proof.  In  order  to  prove  the  result,  it  is  clearly  sufficient  to  show  that  (2.13)  implies  (2.12) 
under  the  assumption  (2.11).  If  X  <at  Y,  then  necessarily  X  <n  Y  and  X  <ci  Y,  and  the 
conclusion  (2.12)  follows  from  Theorem  2bis.  □ 

Theorem  4  is  to  Theorem  1  for  the  ordering  <st  what  Theorem  2bis  is  to  Theorem  2  for 
the  orderings  <ci  and  <cv,  under  the  finite  mean  condition.  This  last  technical  restriction  is 
now  removed. 

Corollary  4.1.  Assume  the  IRn -valued  RV’s  X  and  Y  to  have  the  same  one- dimensional 
marginal  distributions,  namely 

Xi=stYi  1  <i<n.  (2.14) 

Under  this  condition,  the  equivalence  in  law  (2.12)  holds  if  and  only  if  the  RV’s  X  and  Y  are 
comparable  for  the  stochastic  ordering  <st- 
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Proof.  Again,  it  suffices  to  show  that  (2.13)  implies  (2.12)  under  the  assumption  (2.14).  To 
that  end,  consider  the  mapping  ip  :  IR  — >  (—  f ,  f )  :  x  — > ►  Arctg  x,  and  define  the  IRn-\ alued 
RV’s  X  and  Y  componentwise  by 

Xi  =  if>{Xi)  and  Yi  =  iP{Yi)  (2.15) 

for  all  1  <  i  <  n.  It  is  plain  that  the  bounded  RV’s  {X\,---  ,Xn}  and  all  have 

a  finite  mean,  a  property  which  the  original  RV’s  may  not  have  possessed.  Moreover,  the 
condition  (2.11)  is  automatically  satisfied  for  the  Zffn-valued  RV’s  X  and  Y  as  a  consequence 
of  (2.14). 

Since  the  mapping  ip  is  monotone  increasing,  comparability  of  the  RV’s  X  and  Y  under 
the  ordering  <at  implies  comparability  of  the  RV’s  X  and  Y  under  the  same  ordering.  A  direct 
application  of  Theorem  4  yields  the  equality  X  =3t  Y,  a  fact  which  is  clearly  equivalent  to 
X  —st  Y  due  to  the  strict  monotonicity  of  the  mapping  ip.  □ 

It  is  also  possible  to  give  a  direct  proof  of  Corollary  4.1  through  an  argument  by  induction 
on  the  dimension  n.  The  case  n  =  2  follows  readily  from  a  remark  by  Riischendorf  in  [7, 
Thm.  3  ,  p.  344]  which  contains  a  strengthened  version  of  Corollary  4.1  when  n  —  2.  Another 
version  of  this  result  was  also  given  by  Mosler  [5,  Thm.  6,  p.  1316]. 

Theorem  4bis.  Assume  the  IR2 -valued  RV’s  X  —  (Xi^Xz)  and  Y  =  (Yi ,  Y%)  to  have  the 
same  one- dimensional  marginal  distributions,  namely 

X\  =st  Y\  and  X2  =st  Y2.  (2.16) 

Under  this  condition,  the  equivalence  in  law 

X  =»,  Y  (2.17) 

holds  if  and  only  if  both  inequalities 

X<kY  and  X<dY  (2.18) 


hold. 


A  comparison  of  the  assumptions  of  Theorems  4  and  4bis  naturally  suggests  the  following 
question:  Assume  the  RV’s  X  and  Y  to  have  the  same  one-dimensional  marginal  distributions 
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as  in  Theorem  4.  For  n  =  2,  Theorem  4bis  provides  a  strengthening  to  Theorem  4,  since 
the  condition  (2.11)  of  Theorem  4,  originally  given  in  the  ordering  <st,  implies  the  weaker 
condition  (2.18)  in  the  orderings  <£>  and  <k •  It  is  then  tempting  to  ask  whether  Theorem 
4bis  holds  true  for  all  n  >  2,  and  not  merely  for  n  =  2  as  shown  here.  As  to  the  writing  of 
this  paper,  this  is  still  an  open  question. 

3.  APPLICATIONS 

Several  interesting  consequences  of  Theorems  1-4  are  now  presented  in  this  section. 

Bounds  for  Fork-Join  queues 

The  first  application  is  given  in  the  context  of  Fork-Join  (FJ)  queue  models  which  arise  in 
many  application  areas,  including  flexible  manufacturing  and  parallel  processing.  As  discussed 
in  [l],  a  If- dimensional  FJ  queue  is  a  queueing  system  operated  by  parallel  K  servers  with 
synchronized  arrival  streams.  Each  server  is  attended  by  a  buffer  of  infinite  capacity  and 
individually  operates  according  to  the  FIFO  discipline.  Customers  arrive  into  the  system  in 
bulks  of  size  K  and  are  processed  according  to  the  following  discipline:  Upon  arrival,  a  bulk  of 
size  K,  bringing  customers  to  the  K  servers,  is  immediately  split  and  each  one  of  the  customers 
composing  it  is  allocated  to  exactly  one  server  (the  so-called  Fork  primitive).  As  soon  as  all 
the  K  customers  constituting  a  bulk  have  been  serviced,  the  bulk  is  immediately  recomposed 
(the  so-called  Join  primitive)  and  leaves  the  system  at  once. 

In  this  section  only,  the  k-th  component  RV  of  any  ZRK-valued  RV  is  denoted  by  the 
same  symbol  as  this  RV  but  superscripted  by  k.  The  probability  triple  (0,  J,  P)  is  assumed 
to  simultaneously  carry  the  sequences  {rn+i}o°  and  {ern}o°  of  ZR+-valued  and  ZR+ -valued 
RV’s, respectively. 

The  FJ  queue  of  interest  is  then  generated  by  the  constituting  sequence 

7"n+ 1*  ^  0,1,...)  (^'l) 

in  the  following  way:  the  RV’s  (r^f5  model  the  interarrival  times  of  bulk  customers,  in  that 
arrivals  to  the  queues  are  taking  place  along  the  time  sequence  {An}g°  defined  by 

n 

An+i  =  ^2  Tm+i  n  —  0,  l...(3.2) 

m= 0 
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with  Ao  —  0.  The  customers  which  arrive  at  the  k-th  queue  at  such  times  are  called  type  k 
customers  hereafter.  The  n-th  customer  of  type  k  brings  an  amount  of  processing  time  cr£  to 
be  executed  by  the  k-th  server. 

Consider  the  sequence  of  IR+- valued  RV’s  {JVn}o°  generated  componentwise  by  the  re¬ 
cursions 

W'n+l  =  [K  +°n-  rn+l]  +  ,  1  <  k  <  K,  n  =  0,1,  ...(3.3) 

with  Wo  =  0.  The  RV  W %  represents  the  waiting  time  of  the  n-th  customer  of  type  k,  whereas 
its  response  time  is  the  RV  R *  given  by 

Rn-WZ  +  On,  1  <k<K.  n  =  0,1,  ...(3.4) 

The  system  response  times  for  the  n-th  bulk  customer  is  denoted  by  Tn  and  is  given  by 

n  =  0,1,  ...(3.5) 

The  difficulty  of  analyzing  these  queueing  systems  with  synchronization  comes  from  the 
fact  that  these  K  parallel  channels  are  not  independent  even  under  standard  renewal  assump¬ 
tions  because  of  their  common  arrival  pattern.  It  is  this  very  lack  of  independence  that  makes 
the  computation  of  the  joint  statistics  of  the  RV’s  {i?£}o°,  1  <  k  <  K,  and  thus  of  {rn}o°, 
extremely  hard.  In  view  of  these  difficulties,  the  authors  in  [l]  have  used  stochastic  ordering 
methods  to  derive  several  computable  bounds  on  these  statistics.  The  main  results  are  sum¬ 
marized  in  the  next  three  propositions,  where  for  sake  of  simplicity,  the  constituting  sequence 
(3.1)  is  assumed  to  satisfy  the  standard  renewal  assumptions,  i.  e.,  the  sequences  {rn}i°5 
{(rJ}o°,  •••  {&„} o°  form  mutually  independent  renewal  sequences. 

Theorem  5.  Let  the  RV’s  {R*}§°  and  {Tn}§°  be  defined  through  (S.S)-(8.5)  for  the  consti¬ 
tuting  sequence 

(<Tn,E[Tn+1\,  n  =  0,1,...)  (3.6) 

instead  of  (8.1)  .Under  the  foregoing  assumptions  the  RV’s  {Rh, •••,&%}  are  mutually  inde¬ 
pendent  for  all  n  =  0,1...  and  the  inequalities 

Rn<ciRn  n  =  0,1,.  ..(3.7) 


Tn  :=  max  Rz. 

Kk<K  " 
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and 


n  =  0,1,  ...(3.8) 


Tn  <ci  Tn 

hold. 

Theorem  6  below  provides  upper  bounds  when  the  input  process  is  divisible  in  the  sense 
that  the  following  conditions  (D.l)-(D.2)  are  satisfied  by  the  renewal  sequence  {rn+i}o°,  where 
(D.l)  There  exists  a  sequence  {fn+i}o°  of  IR+- valued  RV’s  such  that 

1  K 

Tn+i  =  »  =  0,1,  ...(3.9) 

k= 1 

where  the  K  sequences  {?n+i}o°i  {*n+i}o°  of  i.i.d.  LR+-valued  RV’s  are  mutually 

independent  and  statistically  indistinguishable;  and 
(D.2)  The  families  of  RV’s  {rn+i}§°  and  {<rn}o°  are  mutually  independent. 

For  1  <  k  <  K,  let  {!?£}“  be  the  response  times  in  a  GI/GI/l  queue  with  interarrival 
sequence  (r^+1}§°  and  service  times  {o'*}o°)  and  define  the  RV  Tn  by 

Tn  max  R n  =  0, 1,  ...(3.10) 
i<k<K  n 

Theorem  6.  Under  the  foregoing  assumptions,  the  RV’s  {R^,  •  ■  • ,  Rff  }  are  mutually  indepen¬ 
dent  for  all  n  —  0, 1...,  and  the  inequalities 

Rn<ciRn  »  =  0,1,  ...(3.11) 

and 

Tn  <ciTn  »  =  0,1,  ...(3.12) 

hold. 

The  association  of  some  key  RV’s  is  now  used  to  provide  improved  upper  bounds  on  the 
statistics  of  the  system  response  times  {rn}o°.  In  agreement  with  the  notation  of  Section  1,  the 
RV’s  {Rn,  •  ■  • ,  Rn}  denote  independent  versions  of  the  RV’s  {R\,  •  •  • ,  Rn  }  f°r  all  n  =  0, 1, •  •  • 
Theorem  7.  Under  the  foregoing  assumptions,  the  RV’s  {R^,“  • , R%}  are  associated  for  all 
n  —  0,1, and  consequently 

Tn  <stTn  :=  max  R*.  n  =  0, 1,  ...(3.13) 

1  <k<K 
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The  proofs  of  Theorems  5-7  are  available  in  [l],  together  with  several  other  more  general 
results.  In  view  of  the  developments  of  Section  2,  several  remarks  are  in  order  on  Theorems 
5-7.  It  can  be  shown  that  Tn  <c{  Tn  for  all  n  =  0, 1,  •  •  •,  i.  e.,  Theorem  7  is  an  improvement  on 
the  upper  bound  provided  by  Theorerm  6  for  the  system  response  times  statistics.  However, 
Theorems  1  and  2  show  that  the  bounds  obtained  in  Theorems  5  and  6  are  the  only  ones  that 
hold  in  the  vector  sense.  More  precisely,  there  is  no  possible  vector  ordering  relation  between 
ffn  and  Rn  like  (3.7)  or  (3.11),  under  either  one  of  the  orderings  <st  and  <ci  . 

Bounds  on  the  tail  behavior  of  the  maximum  of  associated  RV’s 

The  tail  behavior  of  an  Iff- valued  RV  X  is  said  to  be  exponentially  bounded  of  parameter 
a  >  0  if 

P[X  >t}  =  o(e~at)  (3.14) 

when  t  goes  to  +oo.  It  is  then  natural  to  say  that  the  RV  X  has  an  exponentially  bounded  tail 
behavior  if  its  tail  behavior  is  exponentially  bounded  for  some  parameter  a  >  0. 

Theorem  8.  Assume  the  IR-valued  RV’s  {Xi,  -  •  -  ,Xn}  to  be  associated.  The  tail  behavior  of 
the  RV  max!<j<nXj  is  exponentially  bounded  if  and  only  if  the  RV’s  {Xi,  •  •  • ,  Xn}  all  have 
an  exponentially  bounded  tail  behavior.  If  the  RV  Xi  has  an  exponentially  bounded  tail  of 
parameter  a;  for  all  1  <  i  <  n,  then  the  RV  maxi  <j<nX*  has  an  exponentially  bounded  tail 
of  parameter  a  =  mini<i<„,  aj. 

Proof.  These  results  are  immediate  consequences  of  the  inequalities 

n 

P[Xi  >  t\  <  P{  max  Xi  >  t]  <  1  -  JI  P[Xi  <  t]  (3.15) 

—  1  =  1 

for  all  t  in  Iff  and  all  1  <  i  <  n.  The  first  inequality  follows  from  the  fact  that  Xi  < 
maxi<i<nXi  for  all  1  <  *  <  n,  whereas  the  second  one  is  a  mere  rephrasing  of  (1.7b).  □ 

A  fact  on  monotone  functions 

An  interesting  and  somewhat  unexpected  by-product  to  the  comparison  results  obtained 
so  far  is  now  given.  Denote  by  Mn  (resp.  .M^)  the  collection  of  all  monotone  non-decreasing 
mappings  IRn  -*■  Iff  (resp.  IRn  ->  IR+).  Moreover,  let  P+  denote  the  collection  of  product- 
form  elements  in  At  +  with  factors  in  .M^,  i.  e.,  an  element  /  of  .MJ  belongs  to  P+  if  and  only 
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f  it  has  the  form 


/ = n  /<  <3-16) 

i=l 

with  fi  in  Mi"  for  all  1  <  i  <  n. 

Theorem  9.  The  collection  of  mappings  P+  cannot  generate  the  collection  .M  +  through 
(positive)  linear  combinations  and  through  limiting  operations  . 

To  the  best  of  the  authors’  knowledge,  there  does  not  seem  to  be  any  direct  proof  in  the 
literature  for  establishing  this  result. 

Proof.  Let  {Xi,  •  •  • ,  Xn}  be  a  set  of  associated  RV’s  with  the  property  that  the  RV  X  is  not 
identical  in  law  with  the  independent  version  X.  Note  that  Fork-Join  queue  systems  provide 
a  rich  class  of  examples  of  such  non-trivial  collections  of  associated  RV’s. 

Therefore,  Theorem  3  asserts  that  X  <k  X  or  equivalently  that 

E\f(X)}  <  E[f(X)}  (3.17) 

for  every  mapping  /  in  P+.  On  the  other  hand,  it  follows  from  Theorem  1  that  the  RV’s  X 
and  X  are  not  comparable  under  the  ordering  <st  since  not  identical  in  law,  and  a  simple 
argument  by  contradiction  readily  shows  that  there  must  exists  an  element  g  in  .M+  (and  not 
merely  in  such  that 

%(X)]  >  %(*)]•  (3.18) 

Details  are  left  to  the  interested  reader  and  the  proof  of  Theorem  9  is  now  completed  upon 
combining  (3.17)  and  (3.18).  □ 

4.  PROOFS 
Auxiliary  results 

The  following  technical  facts  will  be  used  in  the  proofs  of  Theorems  1  and  2bis. 
Proposition  1.  The  inequalities  (1.8)  hold  in  equality  form  for  all  a  (resp.  b)  in  IRn  if  and 
only  if  the  RV’s  {Xi,...,Xn}  are  mutually  independent. 

Proposition  2.  If  the  non-negative  RV’s  X  and  Y  have  finite  identical  means,  then  the 
ordering  X  <ciY  holds  if  and  only  if  the  inequality 

E[h{X)\  <  E[h(Y)}  (4.1) 
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holds  for  all  convex  mappings  h  :  IR+  — >  IR. 

Proposition  1  is  a  simple  rephrasing  of  the  notion  of  independence  and  is  given  for  easy 
reference.  The  characterization  of  the  ordering  <d,  given  in  Proposition  2,  can  be  found  in 
Corollary  8.5.2  of  [6,  p.  271]. 

Note  that  the  ordering  <ci  has  the  anti-symmetry  property  on  the  collection  of  finite  mean 
probability  distributions  with  support  in  IR+  [8,  p.  8].  Therefore,  strict  inequality  in  (4.1)  for 
some  convex  mapping  h  :  IR+  — >  IR  leads  to  the  conclusion  that  the  RV’s  X  and  Y  do  not 
coincide  in  law,  and  consequently  there  must  exist  at  least  one  convex  non-decreasing  mapping 
h  :  IR+  — ►  IR  for  which  the  expectations  exist  and  which  gives  (1.4)  in  strict  inequality  form. 

Proof  of  Theorem  1 

Since  the  RV’s  {Xi,  ...,Xn}  are  associated,  it  follows  readily  from  Lemma  Ibis  and  Propo¬ 
sition  1  that  the  statements  (ii)  and  (iii)  are  equivalent,  and  it  thus  suffices  to  show  that  (i) 
and  (ii)  are  equivalent.  Note  that  if  (ii)  holds,  then  by  (iii),  the  RV’s  X  and  X  are  trivially 
comparable  for  the  stochastic  ordering  <at  owing  to  its  antisymmetry  property  and  (i)  thus 
holds.  The  proof  of  the  second  equivalence  will  be  completed  if  (i)  is  shown  to  imply  (ii).  Al¬ 
though  this  last  implication  is  an  immediate  consequence  of  Corollary  4.1,  a  direct  argument 
of  independent  interest  is  now  provided. 

Assume  that  the  RV’s  X  and  X  are  comparable  for  the  stochastic  ordering  <st,  say  X  <st 
X  for  the  sake  of  discussion.  This  implies  that  X  <k  X  whereas  the  assumed  association  of 
the  RV’s  {Xi,...,Xn}  implies  X  <K  X  by  Theorem  3.  Therefore,  X  =k  X  or  equivalently 
(l.3b)  holds  with  equality  for  all  b  =  (bi,---,bn)  in  IRn,  and  the  conclusion  X  —st  X  is 
immediate.  In  the  event  the  RV’s  X  and  X  were  comparable  for  the  stochastic  ordering  <3t 
with  X  <st  X,  a  similar  argument  using  the  first  inequality  in  (2.5)  would  yield  the  result. 

n 

Proof  of  Theorem  2bis. 

It  is  plain  that  X  <D  Y  if  and  only  if  -Y  <k  -X,  whereas  the  comparability  of  the 
RV’s  X  and  Y  under  the  ordering  <c,  is  equivalent  to  the  comparability  of  the  RV’s  -X  and 
— Y  under  the  ordering  <ct).  Consequently,  it  is  sufficient  to  prove  the  part  of  Theorem  2bis 
related  to  the  ordering  <ci  for  the  part  related  to  the  ordering  <cv  will  follow  by  changing  X 
(resp.  Y)  in  -X  (resp.  —Y). 
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Condition  (ii)  readily  implies  (i)  and  the  proof  of  Theorem  2bis  will  be  completed  if  it 
can  be  shown  that  (i)  implies  (ii).  This  will  be  done  in  two  steps. 

Step  1:  The  desired  implication  is  first  established  in  the  particular  case  where  the  RV’s 
{Xi,...,Xre}  and  {Yi,...,Yn}  are  all  non-negative. 

In  order  to  show  that  (i)  implies  (ii),  the  RV’s  X  and  Y  are  assumed  to  be  comparable 
under  the  ordering  <ci  without  being  identical  in  law  for  otherwise,  the  result  would  be  trivially 
true.  This  last  assumption,  the  ordering  X  <£>  Y  and  Corollary  3.1  combine  to  imply  the 
existence  of  s  ^  0  in  ZR”  such  that  the  strict  inequality 


n  n 

#[exp(—  si^i)]  >  R'[exp(-  Y2  s*5'’*)]  (4-2) 

t=i  i=i 

holds.  With  the  RV’s  U  and  V  defined  by 

n  n 

U  :=Y2s*Xi  and  V:=^SiYi,  (4.3) 

i=i  i=i 

the  inequality  (2.6)  takes  the  form 

E[h(U)\  >  E[h{V )]  (4.4) 

where  the  mapping  h  :  IR+  — >  IR  :  t  — »  exp(— t)  is  clearly  convex. 

Since  the  RV’s  X  and  Y  are  assumed  comparable  under  <ci,  so  are  the  RV’s  U  and  V 
and  direction  of  the  comparison  must  necessarily  be  the  one  between  the  RV’s  X  and  Y .  To 
determine  the  direction  of  this  comparison,  note  that  the  RV’s  U  and  V  are  non-negative  , 
with  identical  and  finite  means  by  virtue  of  (2.9).  Consequently,  Proposition  2  asserts  that 
V  <ci  (  resp.  >ci)  U  if  and  only  if  the  inequality 

E[h{V)}  <  (  resp.  >)E[h{U)}  (4.5) 

holds  for  all  convex  mappings  h  :  IR+  ->  IR  for  which  the  expectations  exist.  The  strict 
inequality  (4.4)  and  the  remarks  following  Proposition  2  now  imply  that  necessarily 

V  <ci  U,  (4.6) 
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with  the  RV’s  U  and  V  not  coinciding  in  law. 

The  comparability  of  the  RV’s  X  and  F  in  the  stochastic  ordering  <c;,  previous  remarks 
and  the  inequality  (4.6)  lead  to  the  conclusion  that  the  inequality 

Y  <d  X  (4.7) 

must  hold.  In  turn  this  implies  that  the  relation 

max  (Fj  -  bi )  <c;  max  (Xi  -  bi).  (4.8) 

l<t<n  l<t<n 

holds  for  all  b  —  (&i,  •  •  • ,  bn)  in  IRn,  since  the  mapping  IRn  — >  IR  :  x  — >  maxi<i<n(xt  —  bi)  is 
convex  and  monotone  non-decreasing. 

On  the  other  hand,  the  relation  X  <r>  Y  readily  implies  via  (2.1)  that 

P[  max  (Xi  —  bi)  <  t  ]  >  P[  max  (Fi  —  bi)  <  t  ]  (4.9) 

l<i<n  l<i<n 

for  all  t  in  IR  and  all  b  in  IRn.  This  last  family  of  inequalities  is  equivalent  to 

max  (Fi  —  bi)  >et  max  (Xi  —  bi)  (4-10) 

l<t<n  l<i<n 

and  since  the  ordering  <at  is  stronger  than  the  ordering  <„*,  the  inequality 

max  (Yi  -  bi)  >ci  max  (X^  —  bi).  (4.11) 

l<i<n 

immediately  follows  for  all  b  in  IRn.  Upon  combining  (4.8)  and  (4.11),  the  equality 

max  (Yi  —  bi)  =st  max  (Xi  —  bi).  (4-12) 

l<z<n  l<z<n 


is  obtained  for  all  b  in  IRn,  or  equivalently  X  =st  F,  a  conclusion  which  contradicts  the 
assumption  that  (ii)  does  not  hold.  In  short,  (i)  implies  (ii)  and  the  proof  of  Theorem  2bis  is 
now  complete  in  the  case  of  non-negative  RV’s. 

Step  2:  To  treat  the  case  of  general  IRn-\ alued  RV’s,  consider  the  mapping  cj>  :  IR  ->  IR+ 


given  by 


exp(x) 
x  +  1 


if  x  <  0; 
if  x  >  0 


(4.13) 
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and  define  the  Iff^-valued  RV’s  X  and  Y  componentwise  by 

Xi  =  <t>{Xi)  and  Yi  =  <f>(Yi )  (4.14) 

for  all  1  <  %  <  n.  The  finite  mean  assumption  on  the  RV’s  {Xi, •  •  • , Xn}  (resp.  {Fi,  •  ■  • , Fn}) 
implies  that  the  RV’s  {Xi ,  •  •  • ,  Xn }  (resp.  { Y\ ,  •  •  • ,  Yn})  also  have  finite  mean.  The  mapping 
< f S  being  monotone  increasing  and  convex,  it  is  easy  to  check  that  the  relation  X  <&  Y  implies 
the  relation  X  <&  Y  and  that  the  RV’s  X  and  Y  are  comparable  in  the  stochastic  ordering  <«.* 
whenever  the  RV’s  X  and  Y  are  assumed  comparable  in  this  ordering.  Under  the  comparability 
condition  (i),  the  first  part  of  the  proof  immediately  implies  that  the  RV’s  X  and  Y  coincide 
in  law,  but  this  is  equivalent  to  the  RV’s  X  and  Y  coinciding  in  law  since  the  mapping  <f>  is 
strictly  monotone,  thus  invertible.  In  other  words,  (i)  implies  (ii)  and  the  proof  of  Theorem 
2bis  is  completed.  n 
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